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CONTENTS SERVER, CONTENTS RECEIVING APPARATUS, NETWORK 
5 SYSTEM AND METHOD FOR ADDING INFORMATION TO DIGITAL 

CONTENTS 



FIELD OF THE INVENTION 

10 

The present invention relates to a method for distributing the digital contents, and more 
particularly to a method for adding predetermined information to the digital contents along with 
the distribution of the digital contents. 

15 BACKGROUND 

In distributing the video or sound as digital data (digital contents), it is common practice to 
embed the electronic watermark information (digital watermark) in the digital contents in order 
to designate a source of the digital contents or enhance the security. 

20 

Nowadays, various kinds of digital contents are distributed on-line via a network such as the 
Internet, in which there is a demand for an application for adding the information (identification 
information) different for each distribution destination or user in distributing the digital 
contents, as prevention means for preventing illegal use of the distributed digital contents, and 

25 means for designating a secondary distribution destination (this application is hereinafter 
referred to as a fingerprint). To implement this fingerprint, the additional information may be 
described in a format header of the digital contents. However, considering that the distributed 
digital contents are possibly subjected to various edits including compression, DA/AD 
conversion, and format conversion, it is effective to embed the additional information to the 

30 digital contents themselves, employing a digital watermark technique. 



As above described, one problem is that in the fingerprint, it is required to change the 
information added to the digital contents for each user to access or each distribution destination. 
35 However, a process of embedding the digital watermark to the digital contents comprises 

- 1 - 



JP920020098US1 



Express Mail Certificate # ER 275502298 US 



calculating an operation amount in a range without influence on the quality of digital contents 
themselves (without deterioration in the visual or aural elements), whereby the processing 
calculation cost is generally very high. Therefore, if a different digital watermark is eniDeaacd 
for each access to the digital contents, a server providing the digital contents (hereinafter 
5 referred to as a contents server) has a very high load. 

In a digital contents distributing system practically on-line, it is required for a plurality of users 
to gain access simultaneously and acquire desired digital contents. However, in the above 
system where the contents server has high load, the number of users capable of gaining access 
1 0 simultaneously can not be increased to lack the practicality of the system. 

In the case where the digital contents are distributed in the recent network system, the digital 
contents of distribution object are usually non-reversibly compressed due to a limited 
bandwidth in the network environment. Therefore, it is required to perform a process of 
15 unpacking and recompressing the digital contents to embed a digital watermark, so that the 
contents server has more load. 

Particularly, in a streaming distribution in which the contents distribution in real time needs to 
be guaranteed for each user, it is a significant problem that the contents server has an increased 
20 load. 

SUMMARY OF THE INVENTION 

Thus, it is an object of the present invention to embed a different digital watermark in the 
25 digital contents for each access without increasing load at the contents server to the utmost. 

Also, it is another object of the invention to implement a digital contents distribution system 
practically on line, employing such a digital watermark-embedding technique. 

30 In order to accomplish the above object, the present invention is implemented as a network 
system configured in the following way. This network system comprises a contents server 
distributing digital contents via a network, and a client terminal receiving the distributed digital 
contents. And this client terminal transmits an acquisition request for desired digital contents to 
the contents server, and the contents server switches and synthesizes the plurality of digital 

35 contents where a different digital watermark is embedded for each specific part to generate the 
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digital contents with predetermined information embedded in response to this acquisition 
reauest and transmits the generated digital contents to the client terminal. 

Preferably, this contents server comprises a contents storage part for storing a plurality of digital 
5 contents where a different digital watermark is embedded, and an information adding part for, 
by reading out a plurality of the digital contents from the contents storage part, switching and 
synthesizing the digital contents for each specific part, adding to the digital contents 
information specified by a digital watermark being embedded for each part of the digital 
contents. 

10 

Also, another network system of the invention comprises a server distributing digital contents, 
and a client terminal receiving the distributed digital contents. This server distributes a plurality 
of digital contents wherein a different digital watermark is embedded at the same time. On the 
other hand, this client terminal switches and synthesizes the plurality of received digital 
1 5 contents for each specific part to add predetermined information to the digital contents. 

This network system is implemented as a broadcasting network such as television broadcasting. 
In this case, the server is a broadcasting station and the client terminal is a receiving apparatus 
such as a television receiver. 

Preferably, this client terminal comprises a receiving means for receiving a plurality of digital 
contents wherein a different digital watermark is embedded, and an information adding means 
for, by switching and synthesizing the plurality of digital contents received by this receiving 
means for each specific part, adding to the digital contents information specified by a digital 
watermark being embedded for each part of the digital contents. 

Moreover, the invention is implemented as a computer configured in the following way. That 
is, this computer comprises a selector for inputting a plurality of digital contents wherein a 
different digital watermark is embedded, and for outputting while switching selectively the 
30 plurality of digital contents for each specific part, and a control part for controlling the selector 
based on a predetermined embedment information, the computer generating by a control at the 
control part, digital contents wherein the embedment information is described with a bit row 
being formed by the digital watermark-embedded in for each of the part of the digital contents. 

35 Another invention to accomplish the above object is implemented as a method for adding 
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information to digital contents by using a computer. That is, this information adding method 
comprises a first step of generating a plurality of digital watermark-embedded contents by 
embedding a different digital watermark in predetermined digital contents, and a second step ui, 
by switching and synthesizing the plurality of digital contents where a different digital 
5 watermark is embedded for each specific part, adding to the digital contents information 
specified by a digital watermark being embedded for each part of the digital contents. 

In this method for adding information to digital contents, the first step comprises compressing 
the generated digital contents, and creating the pointer information pointing to a delimiter 
10 position in the part of the compressed digital contents, and the second step comprises 
synthesizing the digital contents based on the pointer information, and adding the information 
to the digital contents without unpacking the digital contents. 

Further, the invention is implemented as a program for performing the data processing by 
15 controlling a computer. This program comprises a first process for reading out predetermined 
embedment information from a predetermined storage device, and a second process for 
acquiring a plurality of digital contents where a different digital watermark is embedded, 
selectively switching the plurality of digital contents for a specific part, based on the 
embedment information, and generating the digital contents describing the embedment 
20 information, using a bit sequence formed with a digital watermark-embedded in each specific 
part of the digital contents. Such program is provided in a magnetic disk, an optical disk, a 
semiconductor memory, or other recording medium, or distributed via a network. 

THE FIGURES 

25 

Various aspects of the invention are illustrated in the Figures appended hereto. 

Figure 1 is a diagram schematically showing the overall configuration of a digital contents 
distributing system according to a first embodiment of the present invention; 

30 

Figure 2 is a block diagram typically showing a hardware configuration of a computer suitable 
for implementing a contents server according to the first embodiment of the invention; 

Figure 3 is a diagram showing the functional configuration of the contents server according to 
3 5 the first embodiment of the invention; 
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Figure 4 is a diagram for explaining a method for generating the fingerprint information in a 
fingerprint performing part according to the first embodiment ot the invention; 

5 Figure 5 is a diagram for explaining another method for generating the fingerprint information 
in the fingeiprint performing part; 

Figure 6 is a diagram for explaining a further method for generating the fingerprint information 
in the fingeiprint performing part; 

10 

Figure 7 is a flowchart for explaining a process for generating the digital watermark-embedded 
contents in a digital watermark-embedding part according to the first embodiment of the 
invention; 

1 5 Figure 8 is a flowchart for explaining a process for generating the fingerprint information in a 
fingerprint performing part according to the first embodiment of the invention; 

Figure 9 is a block diagram showing a process for making fingerprint with digital watermark in 
the compressed contents according to the first embodiment of the invention, as compared with 
20 the conventional process; 

Figure 10 is diagram showing how to generate the fingerprint information by switching a 
plurality of contents compressed and with digital watermark-embedded for each raw data block; 
and 

25 

Figure 11 is a diagram schematically showing the overall configuration of a system for 
distributing the digital contents according to a second embodiment of the invention. 

As shown in the Figures, element 10 is the Contents server, element 1 1 is the Original contents 
30 storage part, element 12 is the digital watermark-embedding part, element 13 is the Digital 
watermark-embedded contents storage part, element 14 is the Fingerprint performing part, 
element 20 is the Client terminal, element 30 is the Network, element 40 is the Broadcast 
station, element 50 is the Receiving apparatus, element 51 is the Receiving component, 
element 52 is the Contents using part, element 101 is the CPU, element 102 is the M/B chip 
35 set, element 103 is the Main memory, element 105 is the Hard disk, element 106 is the 
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Network interface, element 141 is the Contents selector, and 142 is the Pseudo random 
number generator. 

5 

DETAILED DESCRIPTION 

The first and second embodiments of the present invention will be described below in detail 
with reference to the accompanying drawings. 

10 

[First embodiment] 

Figure 1 is a diagram schematically showing the overall configuration of a digital contents 
distributing system according to a first embodiment of the present invention. 

15 

As shown in Figure 1, the system of this embodiment comprises a contents server 10 that 
possesses and distributes the digital contents (hereinafter simply referred to as contents) such as 
video or sound via a network 30 and a client terminal 20 that receives the contents distributed 
from the contents server 10. 

20 

In this embodiment, the contents server 10 makes a fingerprint with digital watermark in the 
contents in distributing the contents. That is, the contents server adds the information different 
for each distribution destination or user (identification information) to the contents, using the 
digital watermark. 

25 

The client terminal 20 receives the contents distributed from the contents server 10. The user at 
the client terminal 20 operates the client terminal 20 to employ (reproduce or peruse) the 
acquired contents. The fingerprint made in the contents has no influence (deterioration of 
image quality or sound) on the use of the contents, because the information is added using a 
30 digital watermark technique. 

The network 30 is any one of the networks usable for distributing the contents, such as 
information communication networks such as the Internet and various kinds of WAN (Wide 
Area Network) or LAN (Local Area Network), and the broadcasting networks such as for 
35 television broadcasting. The network line may be wire or wireless. 
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Fimire 2 is a block diagram typically showing a hardware configuration of a computer suitable 
for implementing the contents server 10 in this embodiment of the invention. 

5 The computer in Figure 2 comprises a CPU (Central Processing Unit) that is an operation 
means, a main memory 103 connected to the CPU 101 via an M/B (mother board) chip set 102 
and a CPU bus, a video card 104 connected to the CPU 101 via the M/B chip set 102 and an 
AGP (Accelerated Graphics Port), a hard disk 105, a network interface 106 and a USB port 107 
connected to the M/B chip set 102 via a PCI (Peripheral Component Interconnect) bus, and a 
1 0 floppy disk drive 1 09 and a keyboard/mouse 1 1 0 connected via the PCI bus, a bridge circuit 1 08 
and a low speed bus such as an ISA (Industry Standard Architecture) bus to the M/B chip set 
102. 

Figure 2 only exemplifies the hardware configuration of the computer that implements this 
15 embodiment, but various other configurations may be taken as far as this embodiment is 
applicable. For example, a video memory may be only mounted, instead of providing the video 
card 104, to process the image data in the CPU 101. A CD-ROM (Compact Disc Read Only 
Memory) or DVD-ROM (Digital Versatile Disc Read Only Memory) drive may be provided via 
an interface such as ATA (AT Attachment). 

20 

The client terminal 20 may be configured by the computer as shown in Figure 2, like the 
contents server 10. Also, it may be realized by a PDA (Personal Digital Assistant), a portable 
telephone, or other information terminal units having the network fiinction. 

25 Figure 3 is a diagram showing the functional configuration of the contents server 10. 

As shown in Figure 3, the contents server 10 comprises an original contents storage part 1 1 for 
storing the original contents, a digital watermark-embedding part 12 for embedding a digital 
watermark in the original contents, a digital watermark-embedded contents storage part 13 for 
30 storing the contents with the digital watermark-embedded, and a fingerprint performing part 14 
for making a fingerprint (adding fingerprint information) employing the contents with the 
digital watermark-embedded. 

In the configuration as shown in Figure 3, the digital watermark-embedding part 12 and the 
35 fingerprint performing part 14 are virtual software blocks that are implemented by the CPU 101 
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under program control. Also, the original contents storage part 11 and the digital 
wfltftrmarlr-emhedded contents storage part 13 are implemented by a storage device such as the 
main memory 103 or the hard disk 105. 

5 In Figure 3, the characteristic configuration in this embodiment is only shown. In practice, the 
contents server has the general server functions such as accepting an access request from the 
client terminal 20. 

The original contents storage part 1 1 stores the original data of the contents distributed from the 
10 contents server 10, and the digital watermark-embedding part 12 reads out predetermined 
contents from the original contents storage part 1 1 , embeds a digital watermark in the contents, 
and stores the contents in the digital watermark-embedded contents storage part 13. 

The digital watermark-embedding part 12 embeds plural kinds of digital watermark in one kind 
15 of contents to generate a plurality of digital watermark-embedded contents. The plurality of 
generated digital watermark-embedded contents represent the bit information 0 for one part and 
the bit information 1 for the other part. 

Also, an operation of embedding digital watermark in the contents is performed beforehand, 
20 irrespective of the process for distributing the contents. 

The fingerprint performing part 1 4 reads out the digital watermark-embedded contents meaning 
the bit information 0 and the digital watermark-embedded contents meaning the bit information 
1 from the digital watermark-embedded contents storage part 13, and switches and synthesizes 
25 these two kinds of contents for each specific part (partial set). Thereby, a bit row is formed by 
the digital watermark-embedded in the contents and the information in the fingerprint 
(fingerprint information) is described by this bit row. 

This embodiment deals with a digital watermark-embedment detecting method based on a 
30 frequency diffusion technique typically employed as the digital watermark technique. With this 
method, a signal sequence b(n) representing the bit information is modulated by a pseudo 
random number sequence p(n), and convoluted with a partial set C(n) of a contents original 
signal (original contents) C to embed any bit information. The partial set C(n) of the contents 
original signal C is a data set of contents divided in accordance with an appropriate rule. Each 
35 data is a part of original contents, and the whole of the original contents is constituted by an 
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entire set. 

Ce(n) = C(n)+ax[2b(n)-l]xp(n) 
where b(n) = [0,1] 
5 C(n)IC, C(i)UC0)=f (i 1 ]) 

Herein, Ce(n) is a partial set of the contents Ce with the fingerprint made (i.e., for distribution), 
a is a parameter representing the intensity of digital watermark, and n is an index representing a 
part of the contents necessary to embed the 1 bit information. 

10 

In detecting the digital watermark-embedded by this method, the following calculation is 
performed 

R(n) 

15 =Ce(n)xp(n) 

= C(n)xp(n)+ax[2b(n)-l]xp(n) 2 £ ax[2b(n)-l]x( n ) 2 

Thereby, the embedded bit information b(n) is detected by comparing an obtained value with a 
certain threshold. 

20 

Also, in making the fingerprint in the contents with this method, 2b(n)-l takes the values of ±1, 
because the signal sequence b(n) is the bit information. Accordingly, the digital 
watermark-embedding part 12 generates the contents CeO and Cel where digital watermark is 
embedded in both cases of b(n)=0 and b(n)=l . 

25 

CeO(n) = C(n)-ap(n) (CeO(n)ICeO) 
Cel(n) = C(n)+ap(n) (Cel(n)ICel) 

That is, the contents CeO(n) means the bit information 0, and the contents Cel(n) means the bit 
30 information 1 . 

When the fingerprint is made on a contents original signal C, employing the contents CeO and 
Cel with digital watermark-embedded, the fingerprint performing part 14 switches the contents 
Ce0(n) and Cel(n) in accordance with the information m(n) to be embedded as the fingerprint 
35 information (hereinafter referred to as embedment information m(n)) for each partial set C(n). 
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Thereby, the contents Cf where embedment information m(n) described using the bit 
information as the fingerprint information is embedded is generated. The embedment 
information m(n) may be arbitrarily set up, depending on the distribution destination or imic ui 
the contents, and stored in a predetermined storage device (main memory 103 in the computer 
5 as shown in Figure 2). 

Cf(n) = (m(n)=0)? CeO(n):Cel(n) (Cf(n)ICf) 

Where Cf(n) is a partial set of Cf. 

10 

Figure 4 is a diagram for explaining a method for generating the fingerprint information in the 
fingerprint perfonning part 14. 

As shown in Figure 4, the fingerprint performing part 14 comprises a contents selector 141 for 
15 inputting the digital watermark-embedded contents CeO and Cel, and selectively switches and 
outputs the digital contents, and a pseudo random number generator 142 as control means of the 
contents selector 141. 

The contents selector 141 inputs the digital watermark-embedded contents CeO meaning the bit 
20 information 0 and the digital watermark-embedded contents Cel meaning the bit information 1. 
And it selectively switches and outputs a partial set CeO(n) of the contents CeO and a partial set 
Cel(n) of the contents Cel in accordance with a pseudo random number sequence generated by 
the pseudo random number generator 142 to generate the contents Cf with fingerprint made. 

25 The pseudo random number generator 142 calculates a seed of pseudo random number on the 
basis of the access information including the terminal information (terminal ID) of the client 
terminal 20 having issued an acquisition request for the contents and the information regarding 
the user of the client terminal 20 (user ID), calculates a pseudo random number function 
employing the obtained seed, and generates a pseudo random number sequence for controlling 

30 the contents selector 141. 

In this manner, the contents selector 141 is controlled employing the pseudo random number 
sequence generated by the pseudo random number generator 142, so that the bit information is 
formed with digital watermark-embedded for each partial set Cf(n) of the contents Cf with 
35 fingerprint. Employing this bit information, the fingerprint information corresponding to the 
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embedment information m(n) is described in the contents Cf. 

Figure 5 is a diagram for explaining another method tor generating the fingerprint inibraiaiiun 
in the fingerprint performing part 1 4. 

5 

In this example, the contents where a digital watermark corresponding to the bit information 0 
is embedded and the contents where a digital watermark corresponding to the bit information 1 
is embedded are prepared each in plural number. A pseudo random number sequence p(n) for 
describing the bit information is generated employing the predetermined access information and 
10 a certain key. Also, the generated pseudo random number sequence p(n) is changed by 
changing the value of this key in accordance with a certain rule. 

That is, the digital watermark-embedding part 12 generates the digital watermark-embedded 
contents CeOk and the digital watermark-embedded contents Celk in plural number at least 
15 corresponding to the variable kinds of pseudo random number sequence p(n), which are 
employed to describe the fingerprint information. 

Ce0k(n) = C(n)-ap(n,k) (Ce0k(n)ICe0k) 
Celk(n) = C(n)+ap(n,k) (Celk(n)iCelk) 

20 

where k is an index of the key (i.e., seed of pseudo random number). Assuming that the total 
number of k is K, the digital watermark-embedded contents CeOk and the digital 
watermark-embedded contents Celk are generated each at least in K ways. 

25 Referring to Figure 5, the contents selector 141 inputs the digital watermark-embedded contents 
CeOk and the digital watermark-embedded contents Celk each in K ways, and selectively 
switches and outputs a partial set CeOk(n) of the contents CeOk and a partial set Celk(n) of the 
contents Celk in accordance with a pseudo random number sequence generated by the pseudo 
random number generator 142 to generate the contents Cf with fingerprint. 

30 

Cf(n) = (m(n)=0)? CeOk(n):Celk(n) (Cf(n)iCf) 

where A=X?Y:Z is a description method in the programming language such as C language, 
meaning that A=Y if X is true, or A=Z if not. 

35 
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The pseudo random number generator 142 calculates the seed of pseudo random number in a 
maximum of K ways, based on the access information and the key, and calculates a pseudo 
random number function employing the obtained seed to generate a pseudo random number 
sequence for controlling the contents selector 141. 

5 

That is, in this example, though the digital watermark-embedded contents CeOk representing the 
bit information 0 and the digital watermark-embedded contents Celk representing the bit 
information 1 are generated each in plural number, the contents where a digital watermark 
corresponding to the bit information (i.e., 0 or 1) suitable for describing the embedment 

10 information m(n) is embedded is selected, whereby the desired embedment information m(n) is 
embedded as the fingerprint information in the contents Ce. In this case, the digital watermark 
pattern embedded for each partial set Cf(n) in the contents Cf is very diversified, although the 
fingerprint information described by a bit row being formed by the digital watermark is the 
same. Accordingly, it is possible to enhance the security against the attacks from the contents 

15 distribution destination standing in to decode the fingerprint information by changing p(n) 
employing the key for each access. 

Figure 6 is a diagram for explaining a further method for generating the fingerprint information 
in the fingerprint performing part 14. 

20 

In this example, the fingerprint information is generated, employing the original contents C, in 
addition to the digital watermark-embedded contents CeO and the digital watermark-embedded 
contents Cel. That is, a partial set where no bit information is partially embedded is generated 
in the contents Cf. The partial set where no bit information is embedded is varied for each 

25 access. It is supposed that the number s (< N) of partial sets where no bit information is 
partially embedded is known. Herein, N is the total number of partial sets C(n) constituting the 
original contents C. For example, in a case where the five digit bit information "10110" is 
embedded in the contents Cf with s=l, the fingerprint information is generated such as 
"10x1 10" and "101 1x0", if the partial set where no bit information is embedded is represented 

30 by x. 

The bit information is interpreted by discarding s smaller detected values from the detected 
values R(n) detected from all the partial sets Cf(0) to Cf(N-l) (thereby removing the partial sets 
without containing bit information (parts described as x in the above example)), and employing 
3 5 N-s detected values. 
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In Figure 6, the contents selector 141 inputs the digital watermark-embedded contents CeO, the 
digital watermark-embedded contents Cel and the original contents C, and seiectiveiy switches 
and outputs a partial set Ce0(n) of the contents CeO, a partial set Cel(n) of the contents Cel and 
5 a partial set C(n) of the contents C in accordance with a pseudo random number sequence 
generated by the pseudo random number generator 142 to generate the contents Cf with 
fingerprint. 

Cf(n) = (x(n)=l)? C(n):(m(n)=0)? CeO(n):Cel(n) 
10 (Cf(n)ICf) 

Where x(n) is a function of returning 1 in n if the original contents are used, or 0 if not. 

The pseudo random number generator 142 calculates the seed of pseudo random number, based 
15 on the access information, and calculates a pseudo random number function employing the 
obtained seed to generate a pseudo random number sequence for controlling the contents 
selector 141 in the same manner as in Figure 4. 

In this manner, it is possible to enhance the security against the attacks from the contents 
20 distribution destination standing in to decode the fingerprint information by adequately 
providing a part without containing bit information in the contents, and changing the position of 
the part without containing bit information. As a method for embedding the bit information, the 
fingerprint information may be generated employing a plurality of digital watermark-embedded 
contents CeOk and Celk prepared and the original contents C, as shown in Figure 5. 

25 

Referring to the flowcharts of Figures 7 and 8, a processing flow of the contents server 10 in 
this embodiment will be described below. 

Figure 7 is a flowchart for explaining a process for generating the digital watermark-embedded 
30 contents in the digital watermark-embedding part 12, and Figure 8 is a flowchart for explaining 
a process for generating the fingerprint information in the fingerprint performing part 14. Since 
the method for generating the fingerprint information as shown in Figure 4 is considered a 
special case (k=l) of the method as shown in Figure 5, a process for generating the digital 
watermark-embedded contents CeOk and Celk in K ways (total number of k) will be described. 

35 
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As shown in Figure 7, the digital watermark-embedding part 1 2 reads out the original contents 
C to embed a digital watermark from the original contents storage part 1 1 . Then, it is checked 
whether or not the original contents C are compressed, and if compressed, the originai conienis 
are unpacked (steps 701, 702). 

5 

Then, the digital watermark is embedded in the original contents C to generate the 2K digital 
watermark-embedded contents Ce0[l], Ce0[2],.., Ce0[K], Cel[l], Cel[2],.., Cel[K] (step 703). 

Lastly, the digital watermark-embedding part 12 stores the generated digital 
10 watermark-embedded contents Ce0[l], Ce0[2],.., Ce0[K], Cel[l], Cel[2],.., Cel[K] in the 
digital watermark-embedded contents storage part 13 (steps 704, 706). When the digital 
watermark-embedded contents Ce0[l], Ce0[2],.., Ce0[K], Cel[l], Cel[2],.., Cel[K] are 
compressed and stored, each contents are compressed, and the pointer information pointing to a 
delimiter position of a partial set for each compressed contents is generated (steps 704, 705), 
15 and then is stored together with the compressed contents in the digital watermark-embedded 
contents storage part 13 (step 706). The details of the pointer information will be described 
later. 

The fingerprint performing part 14 makes a fingerprint on the contents involving an acquisition 
20 request, when the contents server 10 accepts the acquisition request for the contents from a 
certain client terminal 20. 

As shown in Figure 8, the fingerprint performing part 14 first of all reads out the digital 
watermark-embedded contents Ce0[l], Ce0[2],.., Ce0[K], Cel[l], Cel[2],.., Cel[K] 

25 (hereinafter abbreviated as digital watermark-embedded contents Ce0[k], Cel[k]) for use to 
generate the fingerprint information from the digital watermark-embedded contents storage part 
13. Also, the embedment information m(n) is read from the predetermined storage device (step 
801). And the pseudo random number generator 142 calculates the seed k of pseudo random 
number based on the access information (user ID) contained in the acquisition request and a 

30 predetermined embedment key E (step 802). Namely, 

k = F(E,DD) (F is a function of calculating the seed) 

Then, the pseudo random number generator 142 sets parameter n and the distribution contents 
35 Ce such as n = 1 and Ce = NULL (step 803), and decides a partial set Cf(n) of the contents with 
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fingerprint for the parameter n, based on this parameter n, the seed k of the pseudo random 
number calculated at step 802, and the embedment information m(n) (step 804). Then, the 
contents selector 141 selects any of the partial sets Ce0[k](n) and Cel jkj(n) iui Uie parameter n 
in the digital watermark-embedded contents Ce0[k] and Cel[k]. The partial sets Ce0[k](n) and 
5 Cel [k](n) of the selected contents Ce0[k] and Cel [k] are temporarily held in the predetermined 
storage device (main memory 103 in the computer as shown in Figure 2). When the original 
contents C is also employed to generate the fingerprint information as with the method as 
shown in Figure 6, Cf(n) is selected from any of Ce0[k](n), Cel [k](n) and C(n). 

10 Thereafter, the fingerprint performing part 14 couples the partial set Cf(n) of the contents for 
the decided parameter n with the distribution contents Ce already generated and held in the 
predetermined storage device (step 805). 

Ce = Ce||Cf(n) 

15 

Since initially, Ce=NULL at step 803, it follows that 
Ce = Cf(l) 

20 The distribution contents Ce generated up to step 805 are temporarily held in the predetermined 
storage device (main memory 103 in the computer as shown in Figure 2). 

Then, the fingerprint performing part 14 increments the value of parameter n by 1, and if the 
new value of parameter n is within the total number N of the partial sets C(n) of the original 
25 contents C, the operation gets back to step 804 to repeat the processing for the new parameter n 
(steps 806, 807). If the value of parameter n reaches N, the distribution contents Ce is 
completed and the operation is ended. 

The completed distribution contents Ce are read out from the storage device, and distributed in 
30 accordance with a form of the network 30 to which the contents server 10 is connected (e.g., via 
the network interface 106 as shown in Figure 2) (step 808). When the distribution contents Ce 
are distributed in streaming, the partial sets Cf(n) of the contents with fingerprint decided at 
step 804 are sequentially distributed without waiting for completion of the distribution contents 
Ce. 

35 As described above, in this embodiment, a plurality of contents where a digital watermark is 
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embedded are prepared, and combined and thereby the fingerprint information is added to the 
contents. Accordingly, the processing cost is lower, and the contents server 10 has a reduced 
load, unlike the case where the digital watermark containing ihe imgcipniri iniornianon is 
embedded in the contents. Since the fast processing is made, this embodiment is suitable as a 
5 method for dynamically adding the fingerprint information to the contents after accepting an 
acquisition request for the contents from the client terminal 20. 

By the way, in the case where the original contents of distribution object are compressed, the 
size of the partial set C(n) of the contents to embed the 1 bit information is varied depending on 

10 the value of n. Namely, when the contents selector 141 switches the digital 
watermark-embedded contents CeO and the digital watermark-embedded contents Cel, the 
switching timing can not be provided for each constant number of bits. To solve this, the 
codeword sequence offset information (offset information of bit row) according to the 
compression format is generated to facilitate the switching for each n at the same time when 

15 generating the digital watermark-embedded contents CeO and Cel. And this codeword 
sequence offset information is used as the pointer information pointing to a delimiter position of 
the partial set of each compressed contents (table registering the codeword sequence offset 
information associated with the delimiter position). That is, the fingerprint performing part 14 
generates the contents Cf by switching the compressed digital watermark-embedded contents 

20 CeO and Cel at a position pointed to by the pointer information in the contents selector 141 . 

In this manner, the compressed contents with fingerprint is generated by embedding arbitrary 
information in the compressed contents at lower calculation cost without unpacking the 
compressed contents at all such as decoding the Huffman code or dequantizing by referring to 
25 the codeword sequence offset information. The codeword sequence offset information may be 
compressed and recorded to reduce the capacity of the distribution system. 

For example, when the contents are compressed in MPEG2/4 AAC, the codeword sequence 
offset may be the number of bits for each raw data block or section. To reduce the size of the 
30 codeword offset information, a difference in the number of bits between adjacent raw data 
blocks or sections may be recorded. 

Figure 9 is a block diagram showing a process for making fingerprint with digital watermark in 
the compressed contents according to this embodiment, as compared with the conventional 
35 process. 

- 16 - 



JP920020098US1 



Express Mail Certificate # ER 275502298 US 



As shown in Figure 9, through the conventional process, to embed the digital watermark in the 
contents, the compressed contents are once unpacked (with tiequanuznig in uivcise irequency 
conversion), the digital watermark is embedded, and then recompressed (with frequency 
5 conversion or quantizing) to generate a bit row describing the embedment information. On the 
contrary, in this embodiment, a bit row corresponding to the embedment information is 
generated by selectively switching the partial set of contents based on the embedment 
information (route indicated by the heavy line in Figure 9). Therefore, in this embodiment, an 
operation surrounded by the broken line in Figure 9 is omitted, as compared with the 
10 conventional method. Accordingly, the processing cost for making the fingerprint on the 
contents is reduced, and the contents server 1 0 has a greatly reduced load. 

A process for generating the contents with fingerprint in this embodiment will be specifically 
described below, taking a process for embedding the distribution destination information in 
1 5 distributing the multi-media contents as an instance. 

In the on-line distribution of the image contents or audio contents, when there is a download 
request for the same contents from different users at the same time, a case is considered in 
which a digital watermark containing the different distribution destination information (user 

20 information) is embedded as the fingerprint in response to each request. The image contents or 
audio contents are usually compressed and distributed. However, employing this embodiment 
as above described, the distribution destination information as the fingerprint information can 
be added at lower calculation cost without unpacking the compressed contents. Particularly, 
this embodiment is effective for a streaming type contents distribution in which the real time 

25 processing is required. Also, the temporally changing information (e.g., time stamp) as the 
fingerprint information is dynamically embedded at lower processing cost. 

Specifically, the fingerprint information is added in distributing the contents compressed in 
MPEG-2/4 AAC in the following way. 

30 

(1) Embedding 1 bit information per frame 

When embedding 1 bit information alone for one frame, the digital watermark-embedding part 
12 generates in advance a plurality of compressed contents where single bit information is 
35 embedded and the codeword sequence offset information describing the bit position for each 
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raw data block, without regarding how the frequency components are dealt with, which are 
stored in the digital watermark-embedded contents storage part 13. The adjacent raw data 
blocks overlap by 30% along the time axis. Accordingly, ii the compressed wnicuis are 
selectively switched in a unit of raw data block when the fingerprint performing part 14 
5 generates the fingerprint information, switching of each stream is smoothly made without 
causing the noise. To correctly regenerate the contents generated by switching a plurality of 
streams, it is necessary that for each prepared compressed contents, the sampling frequency, 
channel number, and sound source start time are the same. 

Figure 10 is diagram showing how to generate a bit row (1001..) representing the fingerprint 
10 information (embedment information) by switching the contents where a digital watermark 
corresponding to the value 0 of bit information is embedded and the contents where a digital 
watermark corresponding to the value 1 of bit information is embedded for each raw data block, 
in which the contents are compressed in MPEG-2/4 AAC. 

1 5 (2) Embedding plural pieces of bit information per frame 

When embedding plural pieces of bit information assigned for one frame, it is necessary to 
change a method for processing the frequency data within the raw data block. That is, the 
fingerprint performing part 14 has to switch the prepared contents within the raw data block. 
20 To perform this processing fast without solving the Huffman coding, it is required that the 
section information (section, sectcb, scale factor) of the plurality of prepared contents is the 
same. If the section information is the same, spectral data in the individual channel can be 
switched for each Huffman codeword (every two or four frequency lines). 

25 The digital watermark-embedding part 12 generates beforehand a plurality of compressed 
contents where bit information is embedded and the codeword sequence offset information 
describing the bit position for each raw data block under the above conditions, which are stored 
in the digital watermark-embedded contents storage part 13. Since the prepared contents have 
the same time position and dynamic range, there is a high possibility that the section 

30 information is coincident. However, to correctly make the section information of the contents 
coincident, it is required to assure that an encoder for the digital watermark-embedding part 12 
performs a process for embedding the digital watermark at the time of compressing the 
contents, and at the same time outputs a plurality of compressed contents. 

35 
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In the first embodiment described above, the client terminal 20 transmits an acquisition request 
for the contents to the contents server 10, and in response to this request, the contents server 10 
transmits the contents with fingerprint to the client terminal 20. Un the contrary, in the second 
embodiment, embedding a unique ID in the broadcast (including the multi-cast, and so forth) 
5 contents is implemented with fingerprint using the digital watermark. 

Figure 11 is a diagram schematically showing the overall configuration of a system for 
distributing the digital contents according to a second embodiment of the invention. 

10 As shown in Figure 1 1, the system of this embodiment comprises a broadcasting station 40 as 
the contents server that distributes the contents by broadcasting, and a receiving apparatus 50 as 
the client terminal that receives the contents distributed from the broadcasting station 40. 

In the broadcast for forwarding the contents to a number of users at the same time, it is 
15 Impossible to add different information (tracking code) for each distribution destination to the 
distributed contents. Thus, in the second embodiment, when distributing the contents, the 
contents having two or more different kinds of digital watermarks (digital watermarks 1, 2) 
inserted are transmitted at the same time, whereby the receiving apparatus 50 stores a plurality 
of received contents by switching the digital contents in accordance with a predetermined time 
20 sequence intrinsic to each receiving apparatus 50. That is, in the receiving apparatus 50, the 
contents with fingerprint are generated. Thereby, the fingerprint information different for each 
distribution destination can be embedded in the broadcast contents. 

As described above, the broadcasting station 40 forwards the contents having two or more 
25 different kinds of digital watermarks (corresponding to bit information 0 and 1) inserted at the 
same time. However, these contents may be generated from the original contents using a digital 
watermark-embedding function implemented in the broadcasting station 40, which function is 
the same as for the digital watermark-embedding part 12 in the contents server 10 of the first 
embodiment as shown in Figure 3, or transmitted from the outside by preparing the digital 
30 watermark-embedded contents generated from the predetermined original contents. As 
described in the first embodiment with reference to Figure 6, the contents not containing the 
digital watermark corresponding to bit information may be mixed. The means for broadcasting 
the contents may widely include the electric wave broadcasting such television broadcasting, 
wire broadcasting and information communication network. 

35 
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The receiving apparatus 50 comprises a receiving component 5 1 for receiving the distributed 
contents, and a contents using part 52 for using (regenerating, perusing) the received contents, 
as shown in Figure 1 1 . 

5 The receiving component 51 is realized by a set top box (STB) dedicated for the television 
receiver, for example, and has a function of receiving the general contents, and a function of 
processing the received contents to be usable in the contents using part 52, as well as in this 
second embodiment, the same function of the fingerprint performing part 14 in the contents 
server 10 of the first embodiment as shown in Figure 3. That is, a plurality of contents of the 
10 same contents where a digital watermark corresponding to the bit information 0 or 1 is 
embedded are switched and synthesized for each specific part. Thereby, the contents having 
embedded the fingerprint information described in a bit row being formed by the digital 
watermark are generated. 

15 In this embodiment, an intrinsic apparatus ID (ID-1, ID-2, .., ID-M in the illustrated example) is 
attached to each receiving apparatus 50, and held in a predetermined storage device such as a 
semiconductor memory. The receiving component 5 1 selectively switches a partial set of the 
contents where a digital watermark corresponding to the value 0 of bit information is embedded 
and a partial set of the contents where a digital watermark corresponding to the value 1 of bit 

20 information is embedded in accordance with a time sequence intrinsic to each receiving 
apparatus 50 that is decided on the basis of this apparatus ID, and generates the fingerprint 
information intrinsic to each receiving apparatus 50. 

For example, assuming that the M distribution contents at time t are L(t) (i = 1,.., M), and the 
25 embedment information dependent on the apparatus ID is Off>(t), Oro(t) = If(uo)(t) where f(t,ID) is 
a function of outputting an integer from 1 to n in accordance with the time t. For any ID pair X, 
Y (X 1 Y), there is a certain period to<t<ti for which f(t,X) 1 f(t, Y) is satisfied. 

A specific operation for adding the embedment information as the fingerprint information to the 
30 contents is the same as the process performed by the fingerprint performing part 14 in the first 
embodiment and described with reference to Figure 8. In this embodiment, the pseudo random 
number generator 142 calculates the seed of the pseudo random number function in accordance 
with a time sequence based on the apparatus ID, and the contents selector 141 is controlled in 
accordance with a pseudo random number sequence calculated from this seed. 

35 
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In the above manner, a sequence (secondary information) unique for each distribution 
destination and varying with the elapse of time can be embedded in the contents. The 
information designating the distribution destination alone may be embedded irrespective of the 
elapse of time, depending on the use mode or purpose of the fingerprint information embedded 
5 in the contents. Conversely, the information designating the distribution time alone may be 
embedded irrespective of the distribution destination. Furthermore, other parameters than the 
distribution destination and the distribution time may be set and embedded as the fingerprint 
information in the contents. 

10 The contents using part 52 is realized by a television receiver, for example, to regenerate the 
contents with fingerprint received by the receiving component 5 1 . 

The receiving apparatus 50 comprises a storage means (not shown) such as a magnetic disk unit 
that can store the contents via the receiving components 51. 

15 

The distribution destination and the distribution time of the contents are designated by the 
fingerprint information embedded in the contents in this embodiment. Accordingly, when the 
period or time zone where the specific contents are frequently distributed is investigated or the 
secondary distribution of the predetermined contents is made, it is possible to determine 
20 whether or not the distribution is made without legal right by investigating the source or the 
primary distribution mode. 

In this embodiment, a plurality of contents where a digital watermark is embedded are 
distributed at the same time, and synthesized by the receiving apparatus 50 to add the 

25 apparatus-intrinsic information to the contents. A method for describing the information by 
combining a plurality of contents where a digital watermark is embedded, rather than adding the 
information by embedding the digital watermark in the contents has a lower, processing cost and 
a high speed, and is suitable for adding the information in the contents received by the receiving 
apparatus 50. Accordingly, the information intrinsic to the distribution destination can be added 

30 to the contents in the broadcast or multi-cast with no designation of the distribution destination. 

As described above, with this invention, it is possible to embed a different digital watermark in 
the digital contents for each access without increasing load at the contents server to the utmost. 

35 Also, it is possible to implement a digital contents distribution system practically on line using 
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such a digital watermark-embedding technique. 

While the invention has been described with respect to certain preferred embouuuciib aiai 
exemplifications, it is not intended to limit the scope of the invention thereby, but solely by the 
5 claims appended hereto. 
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